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f fiXECUTIVE SUMMARY 

'ihis report is the fourth in a series qf reports ^ubmitted^ 
to the Office bf Telecoimnianications Policy (OTP) o^ the , 
Department of Health, Education and Welfare (DHEW) in response ' 
to RPP 147-78-HEW-05.* The goals of the contract!- awarded 
to Kalba Bowen Associates in September 1978, were to (1) review 
and evalxaate the ^irst-year activities of ' OTP's Telecommunications 
Program; (2) devtelop approaches'* for evaluating individual 

demonstration^projjects in the future; (3) . identify^ Jactors v ^ 

that have an IhfluBiiae_on-the-su^^ 

and tratisfer of innovative uses of telecommunications; arid (4) 
provide information on which to base future actions for Program 
development and offer recommendations concerning future roles , 
for the program* ' " ^ \ . 

This report, prepared in response to goal three, examines 
whith factors promote or deter the ,ins±ituJ:ionalization of 
demonstration projects in the pxablic service field. ^Alternative 
strategies for institutionalization -and innovation^ dif if us ion / 
are' examined. Barriers to successful ins.titutionalization and 
transfer are ideJvtified through a review of the literature on ' 
demonstration p:rojects conducted by other .^programs and agencies. 
Institutionalization-related results of a survey of recent 
public sei^vice experiments and demonstrations then are' examined. 
^ Based on these reviews, several options for the DHEW program 
are identified. 

Othiar reports resulting from Kalba Bowen Associates' research 
include : . ^ » 

• Evaluation of Telecommunicatijons Demonstration Projects 
and Recommendations to tjie DHEW Telecommunications ^ 
Den?onstration Program , Executive i^ummarv Report ^#14 6-01 

• Evaluation of Telecommunications Demonstration Projects 
\. and Recommendations to the DHEW Telecommunications 

^ Demonstrautipn Program , Summary Report. #146-02 

• Planning and Evaliaating TeTecommunications Demonstration 
Prpjects and Assessing the Costs r of Telecommunications 
Demonstration Projects , Final Report #146-03. . 



'*/ Dur^g the preparation of the final reports, OTP was 

moved from DHEW to the Departanent of Education. .While, 
in some cases/ the .impacts of this move are discussed 
within the context of the reports; we have chosen for 
the most piart to refer to OTP/DHEW since this 'was the 
location of the Telecommunications Demonstration Program 
at the time of our research. 
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1 . 0 ' iNTRODJCJCTION 



> Thi's report' addresses two questioii^^'- F^itst, what ' 
factors promote or d^ter the, institutioi|alrzaiibn an4^^^^^ • 
,o^ demonstrcition' projects in 'the public servide field? , Secondly 
how might the insights gained from exariiinirig. ahswe^rs to 
this Hrst qupstion.,bp used in sha^)ing OTP/DHEjjl's overall 
demonstration . strategy? ' ' , ' ■ , ' 

^ This report is also intended to assist OTP/DHEW in 
resolving some of the specific issues concerning the 
future of thq demonstration program. These issues include, 
but arre' not limited to >' the' following: ' 



,should the program be open to a wide 
rai:xge of demonstration , proposals .or 
should it have a more specific fodus 
(e.g. with respect to technology num- 
ber or type of applications , selection 
of sites or gra^ees, etq.)? 

sHould the ^demonstrations be limited 
to- a one- or two-y^ar period or be 
seen as part of a longer process 
including, possibly, planning, demon- 
stration, review, and evaluation, im-, 
plementation, dissemination and diffu- 
sion phases? 

^ould' local matching funds be /a 
requirement for all or some demonstra- 
tion grants (at all pr some .phasfes of 
the process) ?^ 

CI • • 

what other roles, if any, besides grant 
selection, funding and evaluation should 
OTP/DHEW undertake in support of the 
demonstration program (e.g. technical, 
assistance, information dissemination 
and refe:(:ral, support bf "networking," 
etc . ) ? ' 



In relating 'our fii^dingsil to these specific issues, . . 
we do hot want to imply that other perspectives should V . 
be excluded in shaping the Demonstration P;rogram^., The' , 

fact that a demonstration project is (or is not) converted 

• . ■ ' ' • '■ ' ■' ' ' 

into an operational program is only one measure ;Of its 
iitipact. Other • objectives df the Demons tratip^^ 
could include/ for example: 

• the. generation of information cin the 
costs and/of benefits bf teleco^^nunica- 
tions-supported public service delivery? JL/ 

• the development of local skills in the ^ 
utilization of telecommunications-suppozt- 

ed delivery modes, which may or may not 
correspond to the local institutionali- 
zation of a given ^lemonstration; 

• the creation of broader prof essional^ op 
public awarenes^s" of the potential role V 

V . of telecommtonications .in public service 

. * -^delivery; / ^ i ^ 

'/ • the use of telecommunications technology \ 
as a catalyst for changing or improving, 
other aspects of publiti service delivery; 

• the -"development of new institutional 
relationships (e.g. /federal/local, among, 
local agencies, or between OTP/DHEW and 

^ other DHEW units) , which may or may npt 
have short-term "institutionalization" 
payoffs. / 

At the same time> "institutionalization" is one 



By this measure^ a demonstration <*fhat is not institu- 
tionalized because the telecommunications delivery mode 
is evaluated as not cost effective can be considered a 
"success." ' , N>: 



? legi tilrtate .objective for- the In 
%^the following sect we will (1) exainihe. alternative 
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. '^fr^'^^^^^^^^^^ f^r qiicpuraglng instl'tutionaiizatioh; (2) 

tevi^w research on barriers to Ms tituti^^^ of 

•telecommunications-based service delivery; . ^ 3 ) examin^ ' 

institutionalization-irela,J:ed results in recent public ' 

^ service experiments and demonstt'^tipns; .and (4) discuss 
' ■ ' . '■ " ■ . ■ ' / ■ 

the -implications of these findings for OTP/lDHEW' s deinpn- ' 

stration programs ' ' • • * • . 



- ( 
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2.0 STRATEGIES FOR INSTITUTIONALIZATION AND TRANSFER 

In general iterms, a demonstra'tion project that is 
deisigned to introdiace an innovative service appr6ach is 
institutionalized once it becomes a^ routine activity in 
one or more orgamizations. As Yin suggests^^^ there 



a:^e/a number of signs that typidally accompany institu- 
tionalization, for example: 

j%- ' ^ - . , . . 

• the demonstration project becomes a 
formal program, possibly With its own. % 
line item in the agency's budget; / 

• the innovative approach is continued 

even after key personnel involved in • 
the demonstration leave the agenpy or 
take other responsibilities; 

• personnel associated with the intro- 

V • duction of the new approach are ^ pro- ^ ' * 
\; moted or otherwise rewarded; 

ah ^ongoing training program is esta- ' \ . . ' 

blished to introduce new practitioners 
to the innovative approach; ' 

■m* there is growth in the use of the new 
approach in tbe demonstration agenc J 
, «.and/or other organizations, . 

It should be noted, however, that institutionalization 
does not mean that the innovative approach has been proven 
to be, cost-benef iciaf compared to a more conventional 
approach. It simply signifies that the d^nnovative approach 

■ ■ (■■ . . . ■ ■.■ ■■ ■ ■. 



— ^ See Robert K, Yin,, Ghanging Urban Bureaucracies ; 
New Practices Become Routinized , The Rand Corp- 
oration, Santa Monica^ XA, March; 1978, / 



' has been adopted on an "ongoing basis by the demonstration 
k^ency or some other organization's). Additionally, insti- 
tutionalization should not be equated with "diffusion," 
since it is possible for a service innovation to be adopted^ 
by the^demonstration .agency but nowhere else.—'^ 

2,.l Inatitutionalization Modes and Cycles ^ 

Institutionalization can occur in nnomber of y^ays . 
Generically,, at least five ° options , are possible:' 

■•■ ■ • - I ■ 

1) the demonstration project becomes an 
ongoing program within the demonstration 
agency ; % • 

V ' - ■ . , 

2) the project is institutionalized by some 
other part of the demonstration agency; " 

^ 3), an' outsid^ agency adopts the service 

delivery innovation on a regular basis; . . 

.4) a consortium (possibly including the 
. demons tr a tiori agency) institutionalizes 
/ the innovation; and • 

> ■ ■ ° ' ' \/ 

.5) a nfew agency is created to provide th^ 
innovative service. ' 

In addition, a demonstration project can lead to other 
demonstrations/ which in turn are institutionalized. 

Awareness of these institutionalization options cam 
be important for the selection of . demonstration projects. 



— / s6fae of the differences between institutionalization 
of an innovation and its diffusion or transfer will 
be discussed in Section 3,4 below. 



For instance, an agency which has numerous "branches," such 
as a state health department \^ith multiple clinics, could 
institutionalize a service innovation more easily than a 
single agency.-- all other things being equal. There would 
simply be more choices in finding a suitable setting for 
institutionalization. 'Of course, things are not always 
equal. For formal or informal reasons > the multi-branch 
agency may not allow one branch to deliver services in an 
"idiosyncratic" marine^, howeve^r innovative the approach may 
be.^,.It may also take longer, to arrive at a policy decision 
in the multi-branch agency, particularly if it is larger, , 
older, and more procedure-oriented than the single-brandh 
agency. • 
■ ■ ' ■ r ' . ■ - ' 
These considerations notwithstanding, it may be important 
to take an agency's structural constraints and resources 
into account in selecting demonstration projects. When 
combined wit^ other criteria, such as the agency ' s record 
in adopting service innovations in the past, or its budgetary 
resources, these structural aspects may provide an initial, 
clue. to the likelihood of institutionalization. 

A related factor is where the agency stands with 
respect to the bureaucratic growth ^ycle. As Downs and ' 
others have pointed out, young agencies are more likely to 
seek new* functions and responsibilities, whereas mature ^ 
bureaucracies may be more conce;rned with simply preserving 



their position in a federal r state or local government 
system.—'^ Younger ja^encies are also more likely to reward 
individuals with the initiative to carry forward service 
innovations, a factor that is important in the adoption bf 
innovations. On the other hand /"^younger agencies are less 
likely to be multi-branch or have extensive^ external ties, 
which may be constraints on institutionalization. 

2 . 2 The Service Innovation Process 

While it is useful to contemplate alternative routes 
to institutionalization, the mere existence of one or more 
alternatives will not insure institutionalization. What 
is required for an innovation is a complex coalescence of 
resources not entirely dissimilar from what occurs in the 
private sector when a ,new product or system is introduced. 
Awareness of the innovation must be generated, ihterest 
must be aroused, experimental usage must be facilitated, 
authority figures ~ whether sports nat$ihies, poijLitical 



leaders, or technical consultants * — must b6 willing to 
endorse the product or system, and the whole process must 
be well managed. \ 

\ 

y 

Moreover, the resources brought to bear in insti- 
tutionalizing an innovation are quite different in many * 
cases from those used in the demonstration phase. Idea- 
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A / 

^ Anthony Downs,- Inside Bureaucracy (Boston; . Little, ^ 
Brown* & Co. , 1967) . ^ 



generation, proposal development , staff recruitment, selec- 
tive outreach, sei^ice'reprganization, and. the' procurement and 
use of subcontractors are key elements in the demonstration ^ 
phase. In .contrast,, budgeting, authorization, job specifi- 
cation, professional acceptance, routine butr^each, and 
service management are the overriding functions in the 
institutionalizatioh phase. In the process, the role •'cbf 
local authorities and agencies is 'also likely -to increase. 

' . At the demonstration phase, "the demonstration unit is 

likely to require the following local support: (1) author- 

ization to submit the propSsal; <2) the freedom to conduct 

the project unhampered by regiilatory or bureaucratic con- 

sjjraints; and' (3) ocdt&sional assistance in ' implementing 

the' demonstration, sucA^ as the referral of clients, or the 

.use of faciliti^. For institutionalization to occur, .a . 

number of other forms of loc'al , support must be available. 

• ■■ .... . - 

including: (1) willingness of other units or ag^^ies to 

forego budgq^tary resources alldcated to 'the servicS inno- 
vation; • (2) perm§nent aliocatibn of facilities .to' 
the service innoyati on; ( 3) ongoing cooperation; *and 
(4) ongoing support by local political authorities, pro- 
fessional or labor organizations) third-^arty payment 



institutions and the user c^nunuriity. 

Similarly, if an attempt is made to go beyond the 
initial local instifcutionalizAtion of the service ; innova- 



•tion >.to its teansf er to multiple locations (including 
hon- local ones);; stil^ 

tionships must be brought ■ intb play / vThe^Cqbop v: 
disseminators^of innpvatxve objectives and p^ 

" must be. obtaine^dr wider ih^ innovation 
by service agehc4.es# prof es'isional associations and user 
groups* must (b^ secured; and evaluations indicating ^^ t^^^ 
Appropriate, application auid servifl^ Inno- ^ 

vation need to be circulated. In^araditi availability 
of tiechnical and software resources on a more widespread. ^ . 

abasis must be ensured. Plp^ly, federal support may need^ 
to be made available ^ either fa-om the ori-ginal^ demonstration 
fimder or from ptogr^ agencies pperating .in the same ser.-^ 
vice (BrtVif ionment^ats the service ' inndvatioii; sq:?^€^ 
innovative approach can' -iiei^ tested a^ instiltu- 
tibnalizei^ in Other settings i ^ ^ -w. 

2.3 Participants in Service innovation 

' The changes in activities /and responsibilities pre- 
viously discussed can also be examined from tfi.e perspective 
of asking who participates in the service innovation process 
First/ despite the important roles of obvious participants^ 
such 5is the demonistration im thit part of the demons tra- 
tion; agency directly involved /fn introducing the service 
innovation, ^nd the rd^ agency/ a' niomber V 

of other players must-^also be inyolved. These include the 



demonstration agency, political authorities, equipment . 
suppliers, and professional associations , Among others . 
Secondly, the importance of ra? given .^pl^yer's .participation ' 
can change from one. phase to another. Edr example, national 
associations normally pi ay a minor role, if any, during the 
demonstration and institutionalization phases but could be 
critical participants iti' tiieVtransfer of the innovation^ to 
other settings. Thirdly, the number . of participants with 
a key ro;Le to play often increases from the demonstration 
phase to the institutionalization phase and from the ins ti- 
tutionalizj^tion phase to the transfer phase. 




Exhibit ;i illustrates these points by indicating ' '/ 
yhich players may have .a prima^ry role in each of the thre/ 
phases. The specific listings presented in the table are 
not definitive, since the specific nature of the servi^ce 
innovation^ the original demonstration imit, cind the' i3)sti- 
tutionalization or transfer strategy being pufsued^ could 
alter the player mix. Nonetheless, it provides im overview 
of the complex participation process of ten recjiiired in« ' 
moving an innovation from demonstration ^t.p W 

The greater^nTomber of potential parti/dipants in the 
institutionalization and transfer phases/of service inno- 



/ 
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vationj«is a reflection, in part, of the/ greatet degree of 
inter-institutiorial coordination ' that may be required. 
Whxle xnitiating and implementing a demons trationiproject 
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r ; PARTICIPANTS IN ;TllE iSERVICE INNOVATION PROCESS ^ 

■ ^/ • . PHASES ^ ' ' ' ' ■ , - 

PARTICIPAI^Tg , . ^ DEMONSTRATION , OlPERATIONAL TRANSFER 

Service Innovators ^.-'^ ' ; • 

! Deinoristration ^Unit ' X J 

Demonstiratiori Agency X 
Local Service Agencies 

;otp/dhew\ ' ^ X 

: Service. Providers . X 

Service Recipients 

Grant Applicants) ^ X T 

■• ■ . - ' • ■> .■ ; .c*. ' • ........ , , , •. . ' . . . 

Communications Suppliers 
Equipment Suppliers* , • X; 

Coirantihications Carriers V > 
"Software" Suppliers ' X 

Equipment liidustry 
"Software" Industry 
Other Subcontractors X 

Policy /Community Support 

Federal Authorities 
State/Local: 

Communications Regulators 
'Professional Associations 
Labor Unions * 
User Interest Groups 
General Public (local) 
General Pxibiic (non-local) 

Other Participants * 
Payment Prganizations * 

Private Service Agencies \ 
Professional Schools " 
DREW Agencies (non-OTP) 

Federal Agencies (non-DHEW) ^ 
Press/Media 



X 




,-.■'»■■ 


- X 




.. I ■• "• 


X 




* 'x 






^ X 


X 




' ■ X 


X 






X 
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X 






X 
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involves the developmei:\t of numerous working relationships"; 
mbst of these are in^ternal; only a few are external, such 
aa those between the demonstration agency and the equipment 



supplier. By contrast/ institutionalization and transfer 
are\ likely to require the development of strong relation- 
ship^ wiTth a greater nvunber of external groups and organ-' 
izations, ranging from professibrial associations and local 
political authorities to the media a?d third party payment ' ' 
institutions. At the same -time, the number of relationships 
that wi, 11 come into play can depend on the particular .ir^sti- 
tutionalization or transfer strategy that is being p^utsued.— ^ 
^ome strategies may^equire a small numl^^pf participants , 
others many participants.. 

2.4 ^ Institutionalization and Transfer 

In the remainder of this section we will outline a" few 
of the strategies that cjan be pursued, whether explici-tly or 
implicitly, in achieving institutionalization and transfer. 
Our list is not exhaustive, but is simply meant to suggest 
the 'range of strategy 'Options and some of the implications 
of specific strategies. In general terms, these can be 
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5/ ■ ■ 

— "Strategy" may be too strong a word here / since we 

suspect that many cases involve little conscious 
decision-inaking at a strategic level. Nonetheless, 
organizations attempting to institutionalize or 
transfer a service innovation do pursue certain 
tactics rather than others. The mix of tactics 
employed, and the relationships these tactics gen- 
erate, can be termed a strategy, 

_ % '. ■ ■ ' ' ■ * . ■ • 



divide^ into institutidnalization strategiee and transfer 
Strategies. The foriner are usually aimed at turning a 
demonstration pro ject ^into am bperatiqrial program at an 
agency participacting iil the demons t?:at ion. The latter 

usually seek to diffuse the service innovation beyond the 

. ' ■ • . ■ ' ■ ' . ' * ■■ ■' ' '■ 

immediate institutional pontext of the demonstration > 

• • ■' ' 6/ • ' ' • ^ ■ ^ ' ■ . ■ ■ • ' ' 

pro ject. -2/ 

Examples of institutionalization strategies are the 

following: - v\ 

■ . r- . ■, ; ■ . ■■ \ ■ ■■■■■■ .,■: '} ■ 

• The Local Agency Approach . This repiresents 
the simplest case where a^ local demonstra- 
tion agency attempts tb turn the innovative 
pJro ject into an ongoing program. The strat- 
egy may involve building political and - 
budgetary support among municipal "leaders, 
collaborating with ^bther^^^l • 
agencies, and soliciting the blessing of ' 
local user intei?est groups .^^Local media may 
also play a role. ■ ' 

• The State Agency Approach . A state agency 
- may have a greater choice of sites where 

the service innovation ^^^c be institu- 
tionalized, but it may be more difficult 
to forge relationships w^^ or 
software suppliers an^serviqe providers/ 
especially if a larger-scale or multi-sit^ 
program is involved. ' 



6/ 



A key is^ue irf the case of transfer, strategies* is 
whether to collapse the institutionalization' and 
treinsfer phases into one or whether to wait until 
the service-innovation has been institutionalized 
in one ^ or more sites before attempting 4^ts transfer, 
on a more widespread basis. 



* li " ' • * 

, • A Consortium strategy . It mav be hardf»T- ^ 

% ■ . • 1. . <^^^m^^^^mp^Moi^x^ ^^ecause- of. the differ- > 
ing objectives of ^"t^^ 

operationjal/ hQwever ^ ?|:he p^^ 
J - at greater eh^mcei^^o^^^^ * * 

• budgetary decision is tiicely to require ter- 

iniiiatioh.; ; 
- making "Ijy committee" could stymie the d6vel- ' 

opment and spread of the prograim. 

Similarly, it/ is possible to 'identify a. number of possible 
• * . innovation transfer strategies : ^ » - . 



• The Private Sector Strategy. Key players in 
this case are likely to be private profit, or 
non-profit service agencitas. Communications • 

. " carriers or software suppliers,, pfivate ser- 
vice agencies as well as payment , 
regulators ( competitors may want the service 
curtailed) , the media, and Service recipients. 
The transfer process is rej.atively immune from 
£)olitical influence but may not involve the 
seryide groups with the greatest need. 

• g*ederal/State Collaboration . A new program . 
is launched with partial federal funding ,. 
and state-levfel administration. The cooper- 
ation of professional a.ssociations.,. public 
sector associations, public sector unions,, 
user interest groups, and local service 
agenciies may be critical . Presumably., one 
or more federal agencies would be involved, 
creating potential jurisdictional conflicts . 

• Innovation-oriented "Networking . " The 
initiative here is; taken by a loose coalition 
of- service providers who have been stimulated 
by exposure to the innovative service delivery 
concept through cbnf erenises , professional 
schools, informal contacts , etc. Short-term 
success may be limited by the ].ack of specific 
funding programs, but the op.en-endedness of 
the strategy can have some longer-term payoffs 
as links are formed with federal or local - . 
authorities , serviqe agencies , professional 
associations , user interest groups, and/or ' 
the media . Entry of members of the network 
into the private sector can also stimulate 

• developments there. 

■• ■ ■ ■ ". ' ■■ •■' ■> .:: Kci^' [ ; • ' . , ^ ■■ 



I ,•• • 



'*" 




;V Again ^ the above descriptions are' jtneiant to be briefs 
selective sket.cheis. Howe verV they <3io sug'gei3t some of the 
alternative directions that institutionalization and trans- 
fer e'f forts 'can take. Each strategy involves multiple 
participants but in differing .'ccttfigurations and with \ 
different focal po4.nts. Unfortunately/ little is known 
about,, the appi^pp^iatenQs's of the v&rious strategies for 
teleconiintanicatibns--suppbr'ted social service delivery/ A 
good deal of judgmental decision-making must inevitably go 
into selecting a strategy' for a givefi situation.; What is 
certain / however , is that the fedferalvrole depends on 
which strategy is being pursued, " ^ / 

The issue of appropriate federal roles in demonstra- ^ 
tion projects will be pui:sued in the final section of this 
report/ following a review of specific barriers to institu- 
tionalization and several case studies in the demonstration 
and in5>leinentation of telecommunications-based service / 
innovations. x 
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3.0 i RESEARCH ON BARRIERS' TO INSTITUTIONALIZATION 

\ ■■ ", ' ■ ' ' ' ■■' \ '■ ; ' V ■ '■ ■' ' • ■■■ 

i To obtain a better sense of the opportunities and 

limijtations inherent in different service adoption strat- 

egies, it is important to understand the constraints 

' \ ■ _ , ■ ■ h 

inherent in service innovation. In this secti'on we .will 
•examine several recent studies of the. service innovalf ion 
process which attempt to *isolat6 key bankers and/or fac- 
'tors affecting successful adoptions. Not all of 'the studies 
agte^^^ every point; nonetheless , ai body of knowledge on 
the cpmpie^itle)ij^ institutionalization is being developed 
and is , worth reviewing for our purposes. 

The six studies we will review are the following: 



• Baer, W.S., L.L. Johnson, E.W.Merrow, 

Analysis of Federally Funded Demons tratibn ' 
Projects / prepared for the Experimental 
Technology Incentives Program, U. Si Depart- 
ment' of Commerce, R-1926-DOC, Santa Monica, 

^ CA: The Rand Corporation, April, 1976. 

The goal of this study was to formulate guidp- . 
lines for federal agencies in improving the 
planning, implementation, monitoring, evalua-** 
tion, and dissemination of results of future ' 
demonstration projects. ^ Analysis focussed bri:,^: 
an examination of 24 completed demonstration y^^-- 
projects spanning a wide range of federal ' 
agencies , technologies / and project character- • 
' istics,. .In order to quali*fy, projects had to 
include private business either as the intended, 
adopters pt manufacturers of the' technolo^, 
thus excluding projects aimed at social change . ' 
or requiring ongoing federal assistance. 

\% BermanV P. and M.W. McLaughlin, Federal Pro- 
; grams Suppgrtihg Educational Change , Volume 
i IV: The Findings in Review (April 1975) and 
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Voltanie villi I Ii^ '1/ 
iimovationa : (Mgtf 1978) ;/^piepared or the . ' 

/ UrS; ; Of floe of Eduoat:i^n^^^ 
Health, Eduoat^oh aifi^ W^ 

^ Santa Morilcay CAV^^^^^I^ Corporation. 

This nwlti-yea^ 

ducted to ana;Lyze the evqiution of federally 

funded prograxns designed^^ , t 

spread ifthoVative jiraqtiqis^ in public 

schools ^ The i^first^^p^ 

examined four iifedera^ 

to identif y 1^ 

proHKDte chang^^^ 

exandhed the insii^t prb jetet fac- 

tors that contribute ♦to the r continue 
,and,inc6rpprationV6f 4 

f Imding terinijiiateiv Pindih^s are based on . 
survey SfiLta c^iliect^ 
' pie of 293 change ijge ^ 
detailed case ^studie^ a^ 
federal project cbordinatbts^.^^ 

• Dordick^ H.S. Mid R. J Goldman^ Telecomm 
- nications and 

Barriers to Utili2sation_by v^St^ 
prepared for the Rehabllita^ Services 
Aditdhistratiori, U.SV Depar€i^ He^lthr 
Education and Welfstre, 22-Pt59035/9-01, 
Jios Angeles/ CA: Universils:^ of Soiithern 
California, 1978. 

The purpose of the istudy was t^ assess the 
t>arriers ''to effective litilit^^ of tele- 
' conmvihications technblogies^^b^^^ voca- 
tional' rehabilitation agenqibs ^ Data was , 
collected thrcDugh oyer 130^^ 

phone interviews with vocatf^ 
tion prbfessionalsy teleccix^ 
experts; handicapped individuals and oth^^ 
involved with social se 
tions cipplica!tions*. Inter\iri were 
supplemented by at nationaj, ;^il survey of 
state and private rehlabilitat ion agericies. 

Also, H.S. Dordick and R^^^^^ 
Services and Teleconinunications : Innovatior 
in Hiainan Services Delivery ; 'i Telecoimnuni ca- 
tions Policy/ Jtane, 1978, pp. 137-145, which 
is based on the above study U 
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• Office of T«ohnology A«aeB«in«nt; The Role 
of Damonstgatloni In Federal R&D Pollcv T 
waenington , D i c . t . s .* GoverrimenF f rintli 



Office, July, 1978^. 

The goals of thla atudy were to develop a\ 
GOttceptual framework for the analysis of 
demonstration projects, synthesize the 
literature on demonstrations in relation , 
to this conceptual' framework, and draw ,out\ 
implications of the analysis for Gongresaitonal 
action; Conclusions weve based on a review of 
literature conceited with CI) y demons tr at ionW 
as policy instriamenta,' (2) analyses of speci- 
fic social experiments, (3) ftSD utilization^ 
and. commercialization indirectly relevant tt 
demonstrations, and (4) prescriptive analysed 
of -R&D issues; 



•Yin, R.K., K.A. Heald, M.P. Vogel, P.D. 
Pl6iachawter, and 9,GL. Vladeigk , A Review of 
Case Studies Of TechnoloaicaS, innovations 
in state and Local services , prepared' for ' 
tne National Science Foundation,* R-1870''* 
NSF, S^ta Monica, CA: The'oRand Corpor ation 
February, 1976.^ 

The,,, purpose of this study, aimed, at federal 
policy-makers, was to assess previous experi- 
ences with technological innovatiohfi^h local 
services and to identify those factors that 
have been associated.; i^ith the successful dse 
of such innovations . The study reviewed and 
analyzed l40 case studies of local organiza- 
tions' first experiences with a new techno" 
logical device. 
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Yln,"R.K., S.K. Quick, :P.M. Bateman, and 
E . L . Marks , Changing Urban Bureaucracies; 
How New Practices Become Routlni zed , prepared 
for the National Science Foundation, R-2277- 
NSF, Santa Monica, CA: The Rand Corporation, 
March, 1978 . . - , 

The goal of this study was to describe how 
new practices in urban bureaucracies involved 
in service delivery (i.e. \fire/ police/ educa- 
tion) became routinized; Findings are b^sed 



\ 
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' on lifvhiit'orY an^lyals of 19 Qas» atudlai/ 
' which In aoiM inatancaa had andurad 10 to\l5' 
yaar* . Corroboiratlng avldanaa waa alao oo^- 
lactad through talaphona intarvlawa at 90 
additional altaa. 

In prasonting the data ganamtad* by theaa repaaroh 
projects, we have orgemized Iheir findihga around five\ 
themes. These arei T 



characteristics of ^^e innovation itself 
which nusiy affect adoption; . 

the effects of the organiz atlonal environ*^' 
xnent in which .the innovation Is being 
adopted? / . 

specific Impl^inentation factors which 
could foster the adoption of an innovatijon;/ 

factors which could he Ip^ to diffuse the 
Inxiovatlon from Its initial denonstrat'loh 
to Inore widespread use; \ 

the impact of federal assistance and inter- 
vention on in^ltutlon^lizatibnr / 



"A 



3»1 Characteristics of the Innovation^ 



\ 



The six studies identify three features injbrihsic to 

* I % " 

an innovation which could encourage its adoption within 

the immediate demonstration^ site as well as in pther settings 

These are: 

.... I 

. 1) ^ the use of a technology which requir 
manipulation of a hardware device on 
daily basis'; 

2)., an emphasis on the delivery of services! to 
an .ouibslde user rather than the initiation 
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of . changti ln^lnt«rnal adminiatratlva pro- 
oaduraa; and 

3) a^ Innovation which la coropatlbla with 
existing uaar valuaa or pait exparlences;. 

The Studies 6ttmr conflicting findings on three further 
\ factbriB. These arei > 



4) the use of technologies which are simple 
to operate versus those with complex* 
operating procedures (giv^n sufficient 
practitioner training) ; 



\ 

\ 



5} implementation processes which can be 
developed IncremenliAlly and which can be 
revenged at any point during the course 
\ - ^ of the demonstration versus implementa- ^ 
^ tions which affect immediately and irre- 
\ vocably a core function of the agency 
\ involved in service provision; and ' v? 

\6) innovations which offer an advemtage over ' ^ 

\ the existing service delivery system ver- ^ , 

. sus innovations which affect positively. 

\^ '•bureaucratic self-interest, " 

\ ' . - ■ 

\ ■ ' . 

The first three of these factors need relatively 
little explanation. According to Yin, "successful" inno- 
vative effbrts are^c^orr^lated with the use of hardware 
devices (as ^ opposed to information systems or data analysis) 
A^ecause they \ are visible smd thus moreVeasily commiinicated, 



Yin, R,K,l et A.,, A Review of Case Studies of Tech- 
nological! Inno vat ionj" in State and Local Services , 
Santa Monica, CA: ♦Th^ Rand Corporation, 1976. Yin 
considers a technological 'innovation "successful"^ when f 
it producers a service improvement smd is also ihcor- r 
porated into the activities erf an organization or when } 
it does nop produce any improvement and is not incor- ''^^ 
porated. The two alternative cpmbinations (incorporation 
but no improvement or improvement but not incorporation) 
ajre seen a^ "failures" (pp, lfi-1^) • ' - ^ , 

•-'V 20 , 
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AWitionttXly, lhnoy«tion« that opor«t« on daily* biii^, " 
mvn it thli rsqulirta limiting tht foop* of th« projact 
initially, stand a b«ttar phiinoa of ■uooaaa.-S/ Dordick 
and Goldmin concur, pottiting out that, adoption\ and uia ^ara 
inoit affeotad by tha iubjaotiva viawi of'vpbtan^al uiars 
which are of^an bouhdad by mora ganaral framai of rafaranaa, 
such as attitudes toward tachnology or acianca. Tachnologias 
allowing suqh uaara to aithar obaarva damonstrationa or gain 
personal experience with their appliqationa will ba most 
succesaful, since the perception of risks associated with 
the innovation can be reducea, 

•■ T. ^ ■ : ■ ■ ■ ' • 

Correlated with thip need for visibility, according to 
Yin's 1976 analysiaV is the importance of "tranaitiya* inno- 
vations which deal directly with changes in the way clients 
use services rather than merely with internal changes in 



8/ ^ 

Yin, R.K. , et al. , Changing Urban Bureaucracies; How 
New Prac tices Become Routinlzed . Santa "Monica. CAi The 
Rana corporation, March, 1978. Yin, in his 1978 assess- 
ment, distinguishes between two types of innovations: ' 
task-specific, in which the innbvation is limited to a. 
single service application, and task-diverse, in which - 
an innovation is potentially relevant^ to a variety of 
service applications. The author finds that', in some 
cases, different factors affect the successful routini- 
zation of^ each type of, task. - Thus, i^n the case of , the 
"daily use" factor, a task-specific innovation's inherent 
limitations In performing a diverse arii-ay of applications 
to gain widespread practltloher support is compensated 
by the repetitive number of occasions upon which the 
single relevant application is performed. , 



AdminlitVativo prooa<Jur«».-^ At th« ■amo time, it la 
Important that the innovation not oontliot with a uior'a , 
valuaa or P«it axpariancet. Thui, agi^in, 'matorial innova- 
tiona (hardware davicoa) are more easily adopted than non- 
matarial ones (piroQeasaa^, Ideas ) . Moreover, an innovation 
may have several attrifibtes which users valuer such as 
convenience, increased .job safety, or reduced physical 
'affort, but wh4.oh di«f#iiife valued external 

evalua||*s;,au^ as iii^rd^^ ralj^onse time, lives, saved or^-^^ 
changes in student achiavamenj» Thus, it is important to 
identify and include in servJBkliyery designs pay-offs 
in te^ that practitioners can *dlrec€ly experience. 

Finally, Barman and McLaughlin , among others , note 
that the values and ^oals implicit in ah innovation project's 
design need to be congruent with those of both the project 
participants and their superiors. ^ 



9/ ' - ' 

— ^ It should be- noted that Yin sees these intrinsic features 
(i.e. Visibility and client-focus) as advancing tiie ser- 
vice i*iprovement half of his two-part success model only. 
Incorporation, he feels, occurs when the chief i^xecutlve 
supports the effort; the innovator, implementor, and 
advocate for the effort are located inside the agency; 
and there are no Increases in agency staff. 

Yin, Changing Urban Bureaucracies , o p ', cit. This is 
particularly true of task-specific iXtuatlons for which, 
Yin feels, adoption and implementation are the collective 
result of individual decisions made by individual prac- 
titioners. 



Evidence supportijig;^^^^ / 
" trial^^ility r '"^^^^^^^a^ existirig 
service delivejr/ systeirts factors in adoption dnd ins titu-: 
tionalizatibn i.B riot as clear-cut. T^^ on the 6ne hai^'dy 
both Dor dicic and 'Go^dLmkn^s and Yin' s analyses cit^ past 
research on inribvatidn ' adoption "^b^havior/ which found that 
the complexity bf op (i.e. h\iinb,er of components of 



the technology , 



behaVior^s and skills ' neces sary for success f ul 



■'i' . - - ■• ■; •■ ... T '^^-v: " - ■" - - '■"■"■■■"•11/ 

;use and maihtenanceV etc..) is inversely related to adopt idh.-ir-.'^ 
On the p^er h5|J|tdv^ ;in his 1978 assesa^^^ 
tion'' in urban bureaucracies , finds/ that the amount of per- V 
sonnel training an innovation requires one measure, of | ; 

'complexity ; — doear not affect the outcomes of the task^specific 
innovations he examiried> r given sufficient Vpra^d^^^ payoffs 
(see abovey. [: ■ ' / , 

' - • ■■•••■■'■.■. v.- 1 . \ " ■«"■■.•■■■•■'" " ; ■■• • 

It ib interesting to observe that an .interim evaluation 
of the Fund for this llmprovement of Postsecondary Education 



(PIPSE) comes out even more strongly in favor of complex 
innovations .-—^ " .Research done ' f qr HEW by the NTS Research 



— The degree of coii^plexity ^erc^ived by users may be aggra- 
vated if telecommunications exfierts who consult on the 
; purchase and ins taliation of .equipment , * leave ^ p^ 
staff ^witli little \ training in the daily use and maintenaijce, 
of the technology .\ ' ^ - , • > - ^ . ; 



NTS Research Corporation/ An Evaluation of the Fund if ol^ the 
Improvement of Post;secondary Education / Volume 2; Interim r 
Report, August 1979\. While this study makes several obser- 
vations of relevancfe to this report,, we have not formally 
dncluded it in our ievi^ew because of the inpomplete status 
, . of the projects und^^ v 



. Cori^^^tipn founds ani" iniportarit 

indicator of a project's success.^ . NTS foun^, that 96 perc'ent :; ■ 

. of the education-based projects ftiaded* between P*Y1973 and. 
PY1^79 addressed at least ^^^^f of - ei^t Ccjii^^ : ; 

for establishing the Program.' . Additionally, over Half of the 
projects pursued at least seyein. endeavors (e. g . counseling, 
instruction, faculty development, ^etc'. j^nd created at least . 
five' impacts (e.g., enhanced career opportunities , improved 
instructional techniques, increased access) Such 
"mtaltidimensibnality". was favored by .PIPSE staff under the' 
assumptidn that coriiplex educ,ati,pnal problems Jiad a better- 

'"chanee of succeeding; if several face^ 

were attacked simultaneously. ,. , 

/ Additional disagreements arise over the impacts of 
innovations on organizational practices. Dordick and 
Goldman's and Yin's 1976 analyses find that successful ■ 
innovations are those that are "divisible , " in the sense 



^ While no direct correlation was made in the FIPSE 
report between nxunber of endeavors and/or . impacts 
. and degree of institutionalization , the authors did 
• note that of the Fund's projects which were completed 
or nearing completion and which, were not designed 

' to terminate after aiccomplishing a discrete task, 
70 percent met the' necessary criteria to achieve 
institutionalization.. These criteria were 1) the 
projects continue after Fund support ends; 2) activities 
or services are not substantially reduced; and . " 
3) the project is optimis-tic about its long-term ' 
survival . 



.o • 
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of being testabie^^ 6^^ portion of tJie tairget ' 

poptilation t and "reversible, " in 'that one can return to , 
i the status quo i wit^ lit^ These are in i v 

niarkecl contrast to Yin • s 1978 finding that innovations 
whi,ch ; become routini zed are those which involve a " core 
agency practice . According to this later finding/ a new 
practice can be routinized more ef •eectivelyjfif orie of two 
conditions occur : either the capeibility for cafrying out 
the old practice is systematically removed aftajpthe new y- 



practice has been installed, or the new practice broadens 
the agency's original, array of services and is formally „ 

recognized in a revised version of the agency *s man'datev— ^ 

■ . • . " ■ ■ ■ . . ■ ' . ■ ■ ■ ■ - _ _ " . ' . . ' . . 

/ * / In their analyses of innovation in educational organi- 

. ■ ■ . ' « . ■ .* ' ■ • ' ■ ■ ' • ■-. ...... , , . -. . . ■■ . ' - ■ • 

^ zations , Herman and McLaughlin concur with Yin ' s 1978 findings . 

They observe that "treatment complexity" involving a com^ 

prehensive area of curriculum and a^^^^^^^ mass of project 

participants or requiring an overfill change in teacher • ^ 

behavior is like'ly to induce innovation by establishing ^a 

norm for al^yed behavior in t^ Similarly/ 

projects are more likely to succeed if integrated 

into the on-^going procedures of the school or district. 

In contrast , ^the authors point out that "structt^al complexity"; 

requiring a great deal of co-'Ordination across school 



14/ . V. . -., 

: — ^ This is^ true f or ' both task-specific and task-diverse 
innovat:j.ons , as explained in footnote 8 • 
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-grades and levels -is not likely to result in successful 
. P*^ojects. Finally, the PIPSE ; report menti^^^ - 
that over half of the Fund's projects caus^^ • 
changes in the operiations of the host institution . T 



Pirially, both the Dordick and Goldman and Yi^ Studies 
support the- thesis that an innovation must have a relative 
advantage, over the system it -supercedes. However, drawing • 
from his own case study analysis 

modes of how local agencies innovate, paralleling his two-part 
schema for successful innovations . The first model sees irino- 

■» ■ ■ • ' ■ . ■ ■ .' . ■ • ' ■ 

vation resulting from a concern for product -efficiency. ' It 
emphasizes problem-solving, results in service improvements , 
and is dependent for its success on the merit of th^innovation 
over^ existing practices. " In the Second model, the acceptance 
of an innovation is motivated by bureaucratic self-interest. 
Innovations are adopted where they foster bureaucratic growth. 
Status, and power, even though little service improvement ' 
may occur. Thus, according to this two-part schema, the 
organizational model wit^iin which one operates will determine 
the importance of an innovation's advantage over existing 
systems. ii/ It is only in the ideal case that ServiCe 
improvements also result in bureaucratic rewards or vice 
versa. ■ ' • , . ■ . -4-. 



—'^ NTS Research Corporation, bp. cit . , p. iv-17. 

- XilL(R R.K. , et al. , Changing Urban Bureaucracies / op. cit . 
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3.2 Thtf Orqani zdtioifal Envirorment v 

In examining organizationai f atetors^inf luenoing the adoption 
pf an innovation/ Yin found that , 
in 1976 all undersjcored the bverriding importance of a cen- 
tral ized agency with . one or more layers o f ;supervisory ' relation- 
ships.. While such centralization can prohibit the development ; \ 
. of horizontal coalitions which might: otherwise initiate an - 
innovation^ it does facilitate the adoption of an innovation 
once it has been introduced. In contrast to Yin's fin 
Dordick and Goldman believe that hierarchical structures 
may act as a barrier to innovation because of the high probabi- '" 
; lity that information conveye<a through the organization will 
be .distorted or lost. Additionally /the OTA stMys 
the importance of operational flexibility which allows 
project personnel either to avoid "^br recover from negative 
events or to take advantage of positive ones. We suspect that 
these two conditions are not mutually exclusive and will depend 
upon the jtfprki^g relationships between project directors and 
their staffs. • . ' 

In considering the prganization as it fates the external 
environment, both the Dordick and Goldman and the OTA studies 
stress that innovations requiring cooperative action among ele- 
ments of an institutional enyiroruiient will be less likely to 
diffuse than ones where their application is, within the scope of 
a single institution. Thus, even if the environment is 



.developed, the tetehnology is free of uncertainty and federal 
funding to support th^^^^^^ 

be 4I0W and sporadic if organizations have to (1) share re- 
sources, (2V adjust their operational modes to acpomodat.e . other 
operational units, or (3) accomodat^gencies with disparate 
and conflicting goals. — ^ 1 ! 

Another way in which the organizational environment can 
impinge on the outcome of a demons tratiqn project is through 
the..rules and regulations imposed on" the demonstration agency. 
For example, Dordick and Goldman note that state^p^^ 
policies often require acceptance of the lowest bid. In the 
case of telecommunications equipment, this rule often prevents, 
reliable suppliers from competing, 4nd can result i?n technical 
difficulties at the outset or (during the course of the demon- . 
stration project. Frequently, the ultimate result is that the 

demonstration is terminated. 

• ■■ -. ■ .1 • / ' 

3.3 The Implementation Process 

Perhaps the greatest number of factors influencing the 
institutionalization of an ihhovation are specific "to the 
conditions under which the innovation is implemented. The 
studies identify .seven of these implementation-specific factors: 



17/ 



The OTA study suggests that the use of cable telecommuni- 
cations to provid^ social services will face diffusion 
problems because effective use of the medium requires cooper- 
ation among a number of social -Service and regulatory agen- ) 
cies as well as several levels of government .i.< These -organi^ 
zations frequently ..resist efforts of other agfeQjles to enter 
their area® of specialization. 
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1) thd Ihnoyatioh^^^h^^^ 

agency adm±riisferatorr(^^ 
> ' ahov^ 

3) the innovation should be led by 
an act:iy;e innovatbi* vilio^^ w^^ 

the conditions ^ necessary ^^ f^ ' 

'.. ^^ency's iriitial use of the innovation; ■ / .L..!.:,:. 

4) thosfe with responsibility for the 
diffusion of a^ 

agency should participate in the ; 4 , i 

planning iandbp^^ * ) 

stration including, when necessary, 
practi tioner-i:raini|ig\ 

5) client^ shbuia ^p^ I 
implementation of the demonstration; 

6) there should be, no specif 
. to the innovation; and 

7) no rigid time constraints should be V 
imposed on the innovation. 

Several of the studies st^ress that those demonstiration' 
projects that arrfost successfully diffused are those in 
which 4ie initiatives for action come from local rather than 
federal levels. Baer found in his analysis of de^^^ 
projects that nearly all of the projects which showed little 
or no diffusibri success were pushed strongly by federal agencies 
5P4n concurs, pointing out that since the major conditions that 
lead an innovation to be routini zed all appear to be internal 



18/ Bater categorized cases showing federal initiative as 

- those inyolving^ either (1) a local r federal 
request specifying the kinds of devices, systems, or 
pirocesses to bg demonstrated; or (2) a direct federal 
initiative in which an organization is requested to 
operate^a demonstotion. Xoca3.1y initiated projects are 
those which involve either (1) an unsolicited proposal 
. from a local organization, or (2) . a local responsfe to a 

broad federal initiatiy^ directed towards a^yneral problem. 

'..v. • '.• . - 29 , ; -A ;, ..• / • ,- . 



to the specific local agency, federally initiated agendas 
should.either be limited or designed with great sophisticatipn.i^ 
Dbrdick and, Goldman emphasize that from the potential users' 
\side, clients are most likely to adopt those innovations which 
alleviate an "^agreed-upon high priority need, created either 
by crisis conditions or by chronic service deficiencies. User 
willingness to overcome technical problems and limited resources 
is related to the perceived iiiportance of the need. Finally , 

Berman and McLaughlin point out that projects initiated in 

'f, ; , . ■ ■ ! 

a problem-solving fashion €md addressed at a district's 
central priorities hav^^he best chances for success. As 
the authors observe : . 

" (P)'rojects with high district priority^ were likely- . 
to be continued*, even in cases where they had not , . 

been relatively: successful during their temporary | j 

funding and when they were expensive for the i J 

district." 20/ 'v 

Other implementation-^specific factors largely pertain 
- to the role each member^ of the agency plays in the development 
of the innovation. Thus, top agency administrators who 
are usually involved in key decisions about an innovation, 
such as making available staff or budgetary funds, must 
support the innovation, in effect telling project staff how • 

seriously they should take the innovation's objectives. 

» ' •* . ■ . 

• • . ■..'<»<■ 

Yin, at al. , Changing .U^an Bureaucracies , op > cit . 

— ^ Berman, P. and M.W. McLaughlin, Federal Programs Supporting 
Educat^ional Chcinge, Volume IV: The Findings in Review , 
Santa Monica, CA: The Rand Corporatipn, 19^75, p. 17. 
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Additionailly, a motivated change agent f5.om within the agency 
is needed to bring information into the .iigency, to develop 
support for the innovation , and to establish appropriate 
skills and resources for initially operating it. ^ Although 
this responsibility can be shared by several people, it is 
critical that the innovator (s) come from within the agency 
because such sources habitually carry greater credibility - 
and leverage Hrith other members of the staff. Likewise , 
throughout its early life history, an innovation must gain 
increased support from agency practitioners. Such support 
can be generated> in the case of task-specific innovations , 
by promoting individual use of the innovation ^through the 
provisioDi of practitioner training, frequent and regular . 
planning meetings , and practitioner participation in day- 
to-day implementation meetings. In the case of task'-diverse 
innovations, greater appeals to bureaucratic self-interest 
may be necessary. ^ Finally, client participation ii^'the 
design pf the application is instrumental in assuring the 

V • ' ■ ■ ■ . 

adoption of an innovation not only because such parti- 
cipation enhances cooperation suid identifies unanticipated 
barriers but also, because participation may provide 
external pressure on the process. Consequently, agency 
managers may act with greater care and persevercuice if 
clients are even potentially involved. 



21/ 

— It should be noted that Herman and McLaughlin believe 

that project continuation depends more ^^^o having the early 
and lasting support of a principal who affords the project 
legitimacy and can secure continued funding than on an 
effective project director. This may be;' particularly true 
of educatioi)al settings .^ .v . . 



Two additional factors vidantified by Ipome of the studies 

deserve meiition: the first is that in addiction to internal 

■ \ 

support for an Innovation, no adversary grc^i\p outside the agency 
should specifically opp^' the innovation, ke second is that 
only loose external tjime constraints should be imposed on demon- L 
Stration projects, since, as the Baer study points out, h^w much 
'time a project takes is much less important than the information 
generated. Baer's case study analysis showed- that all the projects 
enjoying greatest diffusion success were able to operate without 
stringent time' deadlines. It may be that setting stringent 
deadlines reduces the amount of external interaction between 
a demonstration agency and other organizations who may adopt the 
innovation in. the future. 

3-4 Factors Affecting- Transfer 

' Three factors have, been identified by the studies as 
affecting the diffusion of an innovation from the demonstration 
site to 'other agencies. These are: 

■ •'■ 

1) the technology used in the innovation 
should be well in hand and highly 
reprodui^flble from site to site; " - 

2) a _ strong industrial system for commer- 
cialization should support the technoloav 
used; and ; 

' 3) ' no major institutional or regulatory 
barriers to diffusion should be 
present. 



Ba«r!i analyBls of tw«nty"*£our domonitratlona Indioataa 
that thoaa projaota having ■Ignlfloant diffusion auooaaa wara 
thoaa with madlum ov low taohnologloal unoarpalnty.^ Thla' 
ralatlonahlp la not aurprialng alnca, aa Baar polnta out, 
tha value of a damonatration in providing uiaful Information 
to potential ajdoptera dependa on ita operat/ing reliably in 
a real world enyironinant* If the technology is not well in 
hand, project managers will be preoccupied with developing 
and improving the technology rather than w^th aaseaslng the 
resulting product or service. Similarly, asDordick and 
Goldman emphasize, potential adopters will be hesitaucit to 
invest resources in a tec|inology if they remain unsure of* 
its reliability, durablliity, administrative feasibility, 
and operating costs under routine conditions • 



The OTA study furthlsr points out <t the importance of 
demonstrations jus ing technologies with high reproducibility 
from site to s:jLte, because unless similar successfij^results 
are experienced at multiple locatioi\s, they wili not be 
credible to potential adopters. 

In addition t^ low technological uncertainty, the Baer 
study emphasizes yrhe Importeuice of a strong industrial system 
for commercialization whos^ various elements (manufacturers 
and purchasers of the new technology, regulators * and other 
target audiences) are included in the demonstration planning 
and ope^ration/1 This may be particularly difficult if the 



jnarMt !■ n«w Bupplitr-purohai^r ralatlonahlpi have not • 
y«t b^n develojpad. However, Beer found thet only one 
demonetratlon, project whidh excluded eoine "active compononte" , 
of the Institutional environment waa diffused. "Active 
components" are defined by Baer as "those (suppliers and/or 
users) v^hose x)ractici^s would have to be modified if the • 

\ ''^ ' \ '■■50/ ■ ■ ' 

diffusion were to take place. "^ 

--^ • i . ■ ■ .\ . ■ ■ • ^ ■ ■ 

Finally, as Baer ij>oint8 out, an innovation clearly will 
not be dlif fused if regulatory or institutional barriers 
prevent jits widespread use. Demonstrations " may be far 
weaker tbola for attacking such^barriors than direct government 
intervenjbion through chjMiges in regulations or subsidies. 
In additjLon, as Dordick and Goldman state, potential users ' 
are less likely to adopt an innovation if they perceive the 

possibility of "red tape." 

i ■ - . ■ . ' • ■ 

.1 • • . . , ^ 

3.5 Federal Funding and Assistance ' " 

' ■ f . . . \. ■ . ' 

Those studies which examine the effect of federal support 
on the institutionalization of innovations make the following \ 
observations: ^ , ^ o 



22/ 

— It should be remembered that Baer's analysis dealt only 
with projects which included private business either as" 
the intended adopters or manufacturers of the innovation. 
His focus on i:he ultimate commercial viability of anfinno- 
vation may lead him to give more emphasis to such factors 
as low technological uncertainty and industrial user/ 
supplier participation in planning than might be required 
by projects with ongoing government support. ' 
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1) ftdtral funding on a oaia-ipaoifio baala 
(i.a., to d«monatratleni) may aotuaXly 
inhibit^ tha tull incorporation of an 
innovation! and 

2) ^ ooit and riak iharing by non»f«daral. 

particlpanta ia cloialy aaaociatad with 
damonatration auooaaa . 

In thair aducational innovation analyaia, Barman and 
MoLaugi^lin concluda that whila fadaral funding pQ^iciaa did 
have' an- impact in providing iropatua to projacta that couljs 
not have otherwiae bean initiated,' federal money in and 

of itaelf did not atimulate aupport, commitment or interest' 

A " * ' J 

in change on the parb of project peraonnel. Since federal 

fxinding did not alter baaic motivationa, it failed to 

influence thof^ features of the innovation that sjiaped 

project impleii^entation strategies or outcomes. 

Additionally, in his 1976 case study analysisV Yin 
diacovered that there was no relationship between the outcome 
of an innovative effort emd the presence of federal support 
for \ such activities as technical- assistance, implementation, 
and ^raining\pf local personnel. 21/ in fact, when Yin examined 
servipe improv^tt^ent and bureaucratic adoption separately. 




23 J 

— Similarly, moat project directors surveyed during 
.the FIPSE evaluation cited in Section 3.1 did not 
believe that the Pund's\moi>itoririg activities sub- 
stantially influenced t^bir projects despite the. 
fact^ that 90 p^eircent had\ found those monitoring 
activities at le^st of sdme help in project operations 
and 80 percent f^und the Fund helpful in identifying 
and correcting specific problems. 
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ht unoov«r«d a nogativ* rolAtlonihip b«two«n bureauorAtlo adop- 
tion and eodaral funding. Yin do«s point out that whilo no aingio 
projaet may bt abla to link ita auccaaa to tha availability - 
of fadaral dollara, auoh aotlvltlaa can be oxtromoly Important 
In davaloplng a more g«naral and Ipng-tarufi RftD capability In 
tha Borvlca •actor, both hy. atlraulatlng tachnologlcal davalopmanta 
and by aupportln^ a network of profeaaiohal aotlvitlee. 
However, he alad atreiaea that the Impact of federal RiiD 
la likely to be limited If it la not adequately tied to gooda 
producera, purchaaera, and even to the actlona of federal 
agenclea In otiier aeotora. 



Closely related to this theme of a federal R&D- commercial 
sector link are arguments for cost and tisk-sharing with non- 
federal participants. These are raised by both the -Baer and 
the OTA studies, which stress that a serious commitment to an 
innovation, as indicated <by/ the performers' willingness to 
share costs and risks, is vital to the successful (operation 
and .diffusion of a demonstration. .Baer's analysis - 
reveals that demonstrations^vith. large shares of federal 
funding (more than 90%)' have a poor chance of diffusion success. 
According to the OTA study, an unwillingness to contribute 
to <:osts m^y reflect technological iincertainty, weak market 
demahd, or inhibiting institutional factors. > 

\ . » 

- fhe focus of 'both the Baer and OTA studies on private 

industry participation in the innovative process may lead them 
- ■ \ • > ^ ' . " '< ' ■ 

to ovej^^mphasize this' cos t-isharing factor. However, Dordick 

-i : , , ■ , / 

■ ■ ' AO ' 



and. Goldnifui's analj^isis' of .-steite; 

also •concludes that, projects operating totally on federal f^ihds^ 
kfe less^rlikely W become ins^itutiorialize^^ those in Which • 

tr the organization invests some 'orb its; dvm tesources. This . 
investment: may be in term^ of (1) sufficient, and l(^g-teinn' ^^^^^ ; 
budget' allocations; (2) > assignment of adequate numbers, of qualified 

' ■ ■■ ■ ■' '■■ ■ , ' ■ •■ 

personnel to the project; (3) Adequate training of Jstaff members; vr 

* •. ' . .' ■ , . ■ ■ ■■■ - » .■ '■ •' ■': ■ - ■ . ■•■ :•. 

and U) provision of ^ sufficient supplies and. main trance. : 



Rxsk'-sharing' is closely connected to qost-sliari / 
according to Baer, anid may be even more important , particii^^ 
larly if cost-participation involves little«rlsk. Thus/- V 
if participants agree to ishare in the construction of a project/ 
but do hot share in contingency cost overruns or stand to 1 ^ 
gain a return on their investment regardless of^ the outcome 
'Of the project r their motivat;Lon to aid in the deyeXopment . 
and diffusion Qf the demonstration^ is weaker than If t|iey 
sustain substantial losses when the project fails •-^'^ 

. . , '. : '■ .■ ,■'.. „-. . s \ :., ■, ■ ■ " ■. 'j- 

. Based on the findings of their" respective studies , 
several of the authors, Baer and Yin in particular^ assess 
the role of the federal government . in promoting the adoption \ 
and routinization of ''•innovations. ^^'^^^^ recommendations all 



24/ Baer^cites the example of a: Personal Rapid Transit System in ■ 
which West Virginia.- University, the county,, and the city of V 
Morgantown all-donated land for the necessary rights of 
way^ as their cds t contributioii to -the demonstration. However / 
a clause m the contract stipulated that if the demons tra- 
. tian did rfot^m^et the university ' s, needs , the .system would 
toe dismantled at federal expense and the land restored 
to Its original , condition-. ' " v 



n^te lindtatipns^^p^^^^^ effectiveness pf dembnWtrationS f or^^ 
° advancing widespread irinovatioh diffusion. ^ ^ ' 

^ x;^ '^^^^ ^ <?<>nci>usi6ns-'dpvm ih^^ 

nagrow {scope f or^ effective 6se sinc:e they.;af e apjiropriate only 
when^ uncertainties are and; a ; strong /rationale for 

federal invQlvement exists; (2) diffusion of demonstrations 
depends oii a\well-Lir^cuiited market "pull" rather th^^ tech- / 
nology "push" ; (3)'' demonstrations are weak tools for tacmri^ 



institutional- and orgianizational barriers to dif fusiorj/ and 
(4) large demonstratioris with heavy federal funding are ^ar- 



t icularly- prone to dif f iculti^T— in 1 igh t' c)f ^the^e^ 

Baer offers, the following strate for sefecting demon-. 

■ ' '■ . ■ ■'i - - ■■ - ■ , ' . :■ . -, ... ■ / ■ - .■ * 

• conduct. the. demonstrations on as small , 

■ -i^-' • ' - a scale and with as little visibility 

■ Y?_ ■ -.as possible; - ^ ' . /h ' ''^ 

: \ . * iJ^P^rpmental iinprpveme^^ 
; \ ^ ^prbdiacts dr^propes^e^^ large 
. ' V X arid ekiDerimentai pro - 

• . make sure technologies being used^are 

well in: hand; and i,/ ^ 

• allow sufficient time for/slippa^^ in 
the project's schedule/ especially ^ 

when the"^ projects are large and tecji- . 
. nologically, uncertain. 



V 
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.Yin,, in the conclusion to his 1976 analysis, suggests 
it .since his evidence showed no relationship between federal 
^P9lij6ies and the "outcomes of specific innovative efforts, such 
sral pQlicies may have to aim' instead at changing some ; 
yjof the common conditions .across local service organizations . 
gThus, rather than funding specific demonstration projebts, 
federal policies cfould be used to . influence^ (1) the social 
network of service -professionals;' (2) the mar Jce ting context 
within which an agency operates; (3) the- organizational context 
within which the agency operates; (4) the internal bureau- 
cratic context by which the agency itself is organized and 
operates; and (5) the regulatory ehviroruRent . • 

In his 1978 analysis, ^Yin points to four additional f une- ' 
tions in which he fe^ls the federal government has a role 
which cannot be fulfilled by other agencies. The - 
CI) support of R&D on innovations that are applicable to loeal 
service agency programs ; ( 2) ' promotion .of the transference 
a,nd diffusion of -ideas from one locAl site ^^^^t^^^^ 
(3) evaluation of local project performance and accomplish- ' 
ments; and (;4) assistance to local jurisdictions in dealing 
With problems deemed national in sigriificance. ■ 



In addition to reviewing the above studies of 
service innpvations/ we perforined a separate analysis of 
factors affecting institutibnalization • Our sample was 53 
demonstration projects utilizing telecommunications in the 
delivery of medical and "health services . These projects, 
which coyer a broad rahg^ of technologies, applications 
and demonstration agencies, are summarized in the Telehealth 
Handbook; A Guide to Telecoimn'unications Technology for • 
Rural Health Care .—^ 



W first phase of our analysis we compared the 

** » ■ ' ■ ■ 

longevity of each project with other factors (such as 

type of technolKigy, application and agency) , ^hich may have ^ 

influenced the duration ^and institutionalization of the - 

project. In a second phase, we interviewed the directors 

of a sample of. the projects, to learn what, if any/ additional 

factors njay have contributed to the .extension or termination 

of their respective projects. 

. ■ ■ ^ • ■ ■ ■ ^. ' ■ ■/ ' ■ ^ .' ' ■ 

4.1 The Cross-Tabulation Results * ^ 

The information that was available to us consisted of the 
project's title, its time period (including whether fitt was on- 
going at the time of pxablication) / the technology (s) ,used (e.g. 



25/ _ 

— Bennett, A.M., W.H. Rappaport and F.L. Skinner, Telehealth 
Handbook : A Guide to Telecbnimunications Technology for 
Rural Health Care , prepared for the National Center for 
Heailth Services .Research, U.S. Department of Health, Education 
and Welfare,' May 1978, pp. 91-146. 



cation (s) /"at: con tact pe^ 
^a 50 to 200 word narrati^ 
the local agencieis involved, -iti^ setting (rural or urbainj / arid 
a brief discusision of the applicati evolution of 

the project. Most of tJhe p^ - 
or middle 1970s. How 

back to 1959 and severalvdthers' were started during the 
late 1960' s. The projects operated in over 3Ci different states. 
• In addition to longevity, the factors we examined in our^^ 

analysis were: 

• type of technology; . ^ ^ 

• number of technologies'* used; " 

• setting (urban or rural) f 

• area covered by service; ' 

• type of application; 

• number of application are^s; 

• contact person; ■ 

• type of organization. 

More specifically, we examined the nximber of yeafs that'demon-^ 
strations with specific characteristics have lasted. These 
results are presented in Exhibit 2. ^ 

Prom these results we see that project longevity does 
appear to be related to certain factors more than others. For ^ 
example, longevity varies by as much as 4.3 years dependingVon 
the type of technology used in the demonstration. By contrast, 
the number, of technologies involved has virtually no' impaict on 
longfevity. 

mc ' ■■■■■■ 
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COMPARIsdN OF PROJfiQT LONGEVITY AND OTHER FACTORS 



Type of technology 
computer ' 
telephone 
satellite ' 

2-wiay audio/data/video 

microwave 

cable 

No i of technologies used 
one 
two 
three 

Setting 
rural 
urban 

;'■ -both" r 

Area covered by service 
local • 



county-wide ~" 

statewide » 

region-wide 

one or more specific 

:.sites > ■ 

O^pe of application 
■ primary care 

education 

administratioi^ 

No. ,of application areas 
one - 
two 

three • 

Contact person 

MD . ■■ . . ' ■ , . 
non-MD . , 

Type of organization 
federal 
state 

vmiversity 
/hospital i 
/ medical iseryice 



No. of Projects 

_ f _ , 

8 

15 . 

8 
27 
18 

28 
16 



18 
9' 

,15 

11 



13 
7 
9 



45 
28 
18 

25 
19 
9 

24 
29 

6 
5 

21 
6 

11 



Longevity 
(Ave. No. of Years) 



4.9 
5.8 
3.6 
6.5 
7.9 
7 • 

6.2' 

6.1 

6.1 

4.7 
• 8.2 
6.5 

7 . 'i 



4.3 
8.4 
8.3 

3.9 

5.7 
7.8 
5.2 

6.1 
6.4 
6 

5.9 
6.5 

5.6 

6 
7.5 

5 
5.1 



v^^I^pbers do not always add up to the total of projects (53) , since in 
- some cases more than one factor applies to a single project and in 

other cases entries were eliminated from the exhibit (i.e., cate- 

gorxes with four or fewer entries) . 
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We will begin, our analysis by examining those factors 
Which appear to be unrelated to longevity. These include 
(1) number of techhoIogies"used , ( 2 Fhumber of application 
areas/ and (3) type pf contact person. In the first two 
• cases, it might be argued that an increase in the number of 
technologies or thfe number of applications would increase the 
complexity of the demonstration project and consequently in- 
crease the possibility of technical or organizational impediments. 
However, this hypothesis is not confirmed by the evidence. 
> "The longevity ^of the projects does not substantially decrease 
; as the number of applications or technologies rises.' \similariy, ; 
longevity does not appear to be affected by whether or not 
the conta'ct person, generally the project leader, is a 
/professional/specialist (M.D. ) or an administtator/manager 
(non-M.D.). ' -rr,.:''^ 

. ■ • . . . ■ . . ■ ■ • It ■ ' . ' 

^•2 Factors Re lated to Longevity 

Two Other fatftors — type of application and type of 
organization — reflect a moderate degree of correlation with 
project longevity. Educational applications have survived, 
longer than primary care applications (e.g. telediagnosis) , ' 
which in turn have fared better than administrative applica- 
tions. These results are not surprising in that the edu- 
cational applications tested were likely to involve more 
conventional uses of technology (e.g. instructional tele- 
vision) than primary care and administrative applications . 
Similarly r the greater longevity of primary care vs. <^ 



administrative applications may be due to the fact that » 
the former are more likely to use visible hardware devices 
. . and to b^ . aimed at outs ide users ; factor^ vrtiich^YiiTand": 
others; have suggested encourage adoption. 

The finding with respect to organizational setting is more 
difficult to interpret. State agencies and, in particular/ 
universities appear to be more successful^dn institutionalizing 
(or prolonging) telemedicine demonstrations than hospital's/ 
medical service organizations, or federal agencies. Possibly, 
. the results suggest that for a demonstration agency to be - 
; successful in institutionalizing a service innovation, it may 
/ n^ed to have a broader range of skills than a ^^r arji t-j ona l 
service provider. Universities^ and st;ate agencies may 
.bring more motivations and resources to the-^mplementation of 
demonstrations than hospitals and medical service organi^t^ions . 
In addition/ they may be less wedded to prevailing service \ 
delivery practices. 

Finally^ there are three other, factors that correlate 
highly with project longevity. These are: (1) the area 
covered by the service demonstration r (2) the type of tech- 
noJ.ogy^ and (3) the setting, in the sample studied, ^ project 
with a statewide 6v region-wide service area was likely to 
last twxce as long \as a coxinty-wide or site-specific demdn- 
stration. Again, iriterpretation of these results is difficult, 
since we suspect they reflect a mi:^ of his-toricar, managerial, and 
political factors. One' possible explanation is that wider-area 
demonstrations are more likely to obtain legislative or 
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budgetairy support at the state level. Another is "that wider- 

P?fo jecta are lik^ly> to Involve more mature techhologies 
aiid less innovative applications. At the same time/ the 
finding challenges the assumption that (demonstrations should 
start small and be liini ted to specif ^^^^^ 

. . ■,■■•>■■ • ' ■ 

The relationship of project longevity to technology, 
though complex, is • in some respects easier to explain. Pro- 
jects utilizing microwave and cable systems as well as 
advanced ^two-way applications exhibited greater longevity 
than those in which satellite and telephone systems or com- 
puters were- involved; The longevity of id.fcrowave- ^d c^^ 

. based projects is due in part- to the maturity of these 
technologies. Their use is likely to present fewer sy stem - 
reliability, availability and/or maintenance problems. ' pn the 

. hand, the shorter life span of the computer-based pro jects 
n>ay^ related to the less ••visible" applications invol^^ 

(i.e. , administrative) and to software development difficulties. 

. , ■ . «. ■■ I ■ . ■ .... ■ _ . 

Pxnally, we suspect that sode of the differences can be ascribed 

■ • : ■. ■ I' .. - - r . .■ V ■ . • ■ . ^ 

to non-technological factorsl such as the duration' of federal 

funding commitments. Many of the satellite service demon- 
strations have been restricted to s-hort-rterm funding, whereas 
a ^number of the two-way (terrestial) applications have received 
extended support. '• 

- ■ . - ' , • - ■ o 

The last factor we were able to identify as potentially 
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26/ It is also possible that some of the statewide and region- 

wide projects were initiated on a smaller scale and were 
\ subsequently expandedVi* " ' 



pl^yiAg an important role with respect to project duration was 
the ^demonstration setting* The longevity of the urban projects 
in our sample was almost twice that of rural projects , with 
mixed urban-rural projects falling in between. Federal 
funding commitments and thia ot)vious difficulties of initiating 
and operating technology-based service innovations in rural 
areas., where the institutional and technological infrastructure 
is likely to be more limited, may have influenced this result;.. 
The<> results, to the extent that they validly reflect urban- 
rural differences, suggest that institutionalization will 
occur , more readily in urban settings^ To the extent that 
project longevity is an objective, they also suggest that 
rurally-oriented projects should invplve an urban component 
as well.—/ 

4.3 A Prof ile on Ongoing Projects 



To reach beyond some of the limitations of the ctoss- 
tabulation approac|i as described- above, we also interviewed 
by telephone the directors of a sample of the health care 
demonstration projects. Twelve projects were chosen to 
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Before utilizing the results of our analysis in designing 
future demonstrations^ several caveats should be taken into 
account, including the* following: Our tabulations included 
both ongoing and terminated projects. Thus, it may be that 
some of the ongoing projects with short life spans because ^ 
\of more recent start-up dat^s will continue to operate and 
in fact be institutionalized. In addition, interdependency 
among factors cannot be measured by means of simple cross- 
tabulations. It is conceivable, as we have tried to suggest 
in our interpretations, that it is a 'particular mix of 
factors rather than any single factor which contributes 
to project longevity or termination. 



represent a range of teohnologies, applloationa , sponsoring 

organizations, and settings. The projects were evenly spread 
' 28/ 
between ongoing and terminated projects. Our questions 

focused on: • 

• technologies used; 

• services provided; . ' , 

• source and type of funding; 

• presence or absence of cost and risk sharing; 
, • use of planning grants; 

• reasons for. continuation or termination of the project; 

• factors promoting diffusi,on; 

.• need for ^VHn|S^^^y government support. --^ 
Our examination of project director responses to these 
question areas has led us to fprmulate the following composite 
de^qription of six ongoing projects, ranging in duration from 
four to thirteen years. The projects almost all use tech- 
»nologies that were fully developed at the time of project 
initiation, including microwave, two-way audio/video/data, 
cable and telephone. Only one site used a new application of 
a developed piroduct. Ensuing technical difficulties led to 
abandonment of the equipment in this case, although service 
delivery continued using iffore conventional means. 

The applications tested in these .projects included primary 
care, education and administration, they involved both single 
and multiple functions, and, they were targeted at both single 
and multiple types pf users. Service delivery covered local, 
regional, and statewide areas arid both urban arid rural Settings. 
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One terminated project could not be used in this analysis 
because of inadequate^^^^^^^^^ provided during the interview. 



4 7 



What 1« important to not^ la that in all oaaes tha projaclt 
axpandad a oora\ function in tha agancy't operations to nJw 



locations . 



While the projects were always centrally administejted , 
input into decisi'on-making was frequently sought from t<jp level 
representatives at user sites. Provision for such input was 
important to the project directors, since all six projects, 
involved the participation of several .agencies both as / \ 
service* deliverers and recipients. Involving several igencies 
may have made agency participation more visible and thUs, less 
easily retractable. It may also have prevented Service appli- < 

cations from- byominq too site-specific and lep p ffapflhio i 

of generating a broad base for- support and/or diffusi'on. 

^ A majority o£ the projects received funding thriugH a 
combination of local initiative and strong federal* Urging to 
"think bigger." One project was • initiated in response to a ' 
federal RPP. Another was mandated by|the state legislature. 
<'ln addition, three of the projects"received seed money for the 
first. one to three years of existence. ^>rhese projects are now 
, largely stelf-suJEficient, relying on charges to users. Medicare 
and Medicaid reiirtburseitients, and ongoing support as line items 
in state^health care budgets. The remaining three' projects 
' have received ongoing federal or state support since their 
initiation, supplemented again by. user charges and/br grarits 
made to individual service providers. None of the projects 
required explicit cost- or risk-sharing on the part of the 



service deliverer. 
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Hklf of tht proj*9ti did not hav« planning qMnii and 
proJaotV dlraotora Jdo' W think thay would hava ba^^ ua^iful, 
Tha ramalning p^ojaota Wtd planning grantA ranging If rora $14,000 
to*$5^,00y and/found tham uaaful in geharaiing inLtaat and 
coordinating afforta but not a vital atap ih tha jaeyalopmant 
of the .projjact. 

IProjacy diracij^ra at)^tibut^d thair auccaaaaa to aavaral 

factiora. , Pjirat among therfa ia tha axiatanca of a aubatantial 
need -for the! 



cases; this 



Interest and 



service^ provided by the project. In several 



leed was ihi^tially pr6vider-<lrive*n w4-th community 



involvement coming later.' Additionally, the 



directors fejlt that theiA projects had developed because of thL 
^ individual E^^rsonalities involved their vision could F 
generate both top-level silpport for the project and Establish ' 
facilitating connections w;ith other agencies. One project 
director also pointed out that the political and budgetary 
climate- in/ the early 1970 's had cultivated a p^sonal di.plOmacy 
which may po longer be possible. 'Thirdly, directors attribdied 
their suc?:esses to the participation of highly-qualified stiff, 
who perce/ived the projects as opportunities to develop their 
careers../ Finally, several project direbtors stressed the roi^ 
of on-sit^ coordinators or promoters who"^ged and facilitated 
use of the system;. . 

, Project directors were unclear on mechanisms for promoting, 
the yd(^ption of their service delivery systems at other sites . 



\ 
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l| ,9nly two paseB had the government (at the 
jknV role in diffusion, in one casd the 



In. the second 
fimded three 
In cons 



Moit £«lt that Informal aif fusion wa» proyid«d as ptiyiiciaAs 
and atudanta obaarVing' or working in tha rfyatam'movad to othar 
. ibca^iona. Ona projact |diraoteor advooatad that doctor a who had 
lad tha initial projact Ida valbpmant ahould be tha onaa to 
adviaa othar aitea. Anithar director explained that, although ' 
'aimirar projects axiajta^, diffusion had been' very slow until 
the projects banded together to share information resources; 
once such cooperatlori had been established, however, diffusion 
occurred rapidly, 
state level) played 

Department of Elderly /Affairs replicated the original project 
model as a result of ongoing contact between state agendies, 

ise^'tke state Medicaid office issued em RPP and 
new projects based on the initial project approach. 
Aderihg ways in which the government might provide ' 
assistance beyond funding, project directors urged that ^^^m 
the outset federal, f under s should view innovative projects 
as potentially successful businesses and jBftould both 
promote and,: where possible, facilitate the transition to 
self-sufficiency through contacts/ lobbying for changes, in pro- ' 
Jtiibitive federal/ policies or other means. They further urged that 
given the goal of Self-su£ficiency, the government should be 

willing to make' longer-term financial commitments to projects^ 

^ - ■ 

(up to five ye^ars) so that projects with the potential for 

success would;' not collapse prematurely for lack of funds. The ' 

project leaders also favored mandatory site visits to similar 

■ ■,.'"■/ . ' * ■ 

projects fof infoxnnation-sharing purposes. 
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2?--'W.: 4.4 Ai jProf ile of Termi 

In ^yal^ directors wtiose projeets hi4 

lasted from ni^ were then terminated , « 

seyeSral interesting doxi^ profile become 

^parent; Almost all of the projects in 

: •■■ . .:/'■ ; '^'x • V" V:A-v;^v- , ".V ' ■ - ■ l-^- • •■ : . .; 

siiaple applications to single target groups at spec^^ 

In addition/, no cooperation between autonomous^ a 
required. Less than ha;if of the piioject^ 
' locally; the othets, were responses ta a specif ic • 
, V^the urging of private industry , or direct federal solicitation^ 
, > Pxnally/ all but one of the projects received seed funds only. / 
While each project director named a specific reason for why 
the ptdject was terminated ^ these reasons stemmed largely firoin 
the above chtaracteri sticks. .For example, in one, site-specif ic 
application, a change in medical personnel obviated the need , 
for the service provided by the project. For other 
projects, the relative- simplicity of the application' an^ its 
single agency focus ma^e it easier for one malfunctioning 
element to disrupt the^entire project and/or for projects 
with problems ; to be abandoned when their supporting agencies 
experienced; a financial crunch. - |, 

.. :. ; Secondly , those projects which were:^ initiated iri response^ 
to external encouragement rather than a locally-felt need 
encountered several problems which would have probably detefred 
.them from initiating such efforts on their qwh and which con- 
tributed to their termination.. These problems included lack 
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■ ; of cie^iTCut uSer ihtere with service • pro- ' 

; videirsv ; pbliticfitl conflicts between uiser ^^tes , and a lack of 
top-- level coinmtment. ^ several cases / . such "exte^'n-ally- 
gerierateij prpj;gcts also resuited in services with , no clear 

advsuitacfe to users and technologies- that were, inconvenient 

'-^ .\ ■ . ■^•yw' ' :\' ^ 

for users, to work with and/or costly ^ particularly where these 

technologies were experimerjtal . • 

Finally, (according to project directors) short-term 
V^.seed funding which was terminated prematurely an^/or\punding 
. which reqviired cost-sharing between the federal government . and 
s;tate; or local agencies with fluctuating budgets led td 
ctip^ling financial obstacles in several cases . 1 1 is also- 

, ' " . <■ . • ■ - ■ . - ^ 

xntqresting to note that even in those <3ases in which -projects 
had the support of commercial entities ta cable TV company. 
Bell system) , budget cuts in one case and inappropriate 
technologies in the second terminated the project, 

H ■ . • • 

4.5 Summary of the Findings , 

. In reviewing these projects, it should be remembered that 
Some of the factors We have attributed to their success or 
termination may be influenced by the projects ' particular ^ ^ 
focus on health care services, Thiis , applications which 
expand a core function ^in an agency ^s operations to new 
locatioris, the absfehce of initial cost/risk sharing with 
state o^ local agencies, and the opportunity" fbr projects 
to be absbrbed' ultimately into ongoing state or Medicare 
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budge^s^ may be factoids which are particularly relevant 

' " '' ■ " ■ , _ , ■ • ' , ,' ' ■ f - ■, 

in: health ^car^ situations. Nevertheless, >e» t>,elieve that 

most 'the factors di scus sed above have .re le vance to a broader 

range of social service applications . * 

Based on our analysis , we^v factors . 

which appear to positivelyyi^^ 

institutionalization of health care demonstration prp^edts. 
These are: • ■ ' • • ■. 

• the use of fully-devdloped technologies; 'V 

• applications which extend an agency's core function (s) 
to new locations; / - ', 

• central--agency management but p par- 
ticipation of several autonomous agencies in the . 
delivez?y or receipt of a sefvi^ce) • ' 

• a project which ^-is^'locall^^^^^^ V 
user-felt needs but which peceives federal encour-? 
agemeht to enlarge service delivery plans where 

: ;necessary;^-/^^"-..\/ \- . 

• no initial cost or risk sharing by state or local 
agencies if budgets appiear unstable; 

• opportunities for costs pf established projects feo 
'be a^orbed either into state or local ongoing 
budgets or to be; covered by user or institutional 

^ ' charges, etc.; : , ' ^ 

project personnel with connections to other influ- 
ential agencies (fn some cases, 'such connections 
are the result of a single strong personality and 
-^cannot be villi fully incJ^ude^ design); 

, . projects which of fer personnel increased oppor- 

tunities for career development; ' . 

V -^- '.^^ ^ , ■ ^ . ■ ' '. . ■ 

• provisioits jfor information exchange and 'diffusion 

• through both fom'al a«d^nscheduled.y 

sites* attempting .similar service dejj. very systems; 
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• government support for and facilitation of a 
\ transition to self T 
of the aEJpXication of business principles to 
project management,, s^ssistance in the establishment 
of federal agency contacts ,, and promotion both 
to other federal; state, and/or local agencies 
and -'to users within the pra^ ^ V 

site. ^ • 

Seiveral of these factors including the use of fully- 
developed technologies, central agency management, and satis- 
faction of user-perceived needs corroborate the re s^^ 
findings detaile^fl earlier - in^this report (Section 3) . Other 
factors , however i such as the benefits of collaborative 
relations b^etween autonomous agencies and the hazards of 

■■" ^ , . \ . V; . ' ■ 

cost- or risk-sharing requirements are in direct conflict ^ 
with the earlier £i]^^ we have found 

'that projects with wide-area coverage, iindertak state 
agencies or Tiniversi ties are more likely to endure than 
rural, singler-site, local agency projects. Similarly/ projects 
involving educational applications have a higher chance of 
surviving than those with primary care and, especially, ^ 
admxnistrative applications.^ 



5'. 'O- OPTIONS -rJ^D/'lMPL ■■ ' ' ' 

In this -final section, we will apply our research to 
the design jand of OTP/DHEW^ s demonstration program. . 

Our discussion of opitions and^ s cburses of action will , 

: in some cases, also be based on kiioy^ledge of how related 

deinonstration programs operate. Specifically, we will a'ddress 
how OTP might modify its demonstration program guidelines and 

y grantee selection criteria in light of the research findings v 
as well as alternative activities it might \andertake to foster 
the! institutionalization of demonstration projects. * 

Before prbceeding with our suggestions, two points need 

to be re-enphaSized. - One is that the primary perspective of 

this report continues to be that of institutionalising demon- 

strations. As noted in the introduction to tfis report, we 

recognize that institutionalization ittay be only one ^of several 

legitimate program objectives. Consequently, pur stiggestions 

should l^e evaluated against other objectives that^may be 

pertinent. Secohdiy, it is obvious that sound research on 

the institutionalization process for social service innovations 

is only beginning to develop. As we have noted in previous 

. • ; . <% * ■ 

sectxons, conflicting evidence exists on a number of , important 

issu^; such as tjje role of formal and inforinal collaboration 

■■ ■ ■ • " 

among institutions. Other issues have ?iot been examined 

systematically, if at all. Our suggestions should be seen in 
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this context. They^ are not magic formulae, but they may add 
some value to OTP's internal decision -making. 

5.1 Program Impiications 

There are a nufliber of interrelated issues that .arise with 
respect to how OTP's demonstration program might be restructured: 

• how much emphasis should be placed on 

new vs. established technologies? ^ 

• should single- or multi-service 
applications be supported? 

• should a larger or smaller number 
of projects be supported and how 
much of the budget should be allo- 
cated to continuation support? ' \ 

m what kinds of institutions should 
be supported? 

• • should cost-sharing requirements be 
made more explicit or increased? 

• should a planning phase precede the 
demonstration phase? ' . 

• . ■ 

Several of these issues can be addressed in terms of 
the research results detailed in earlier sections of this 
report (Sections 3 and 4). These findings suggest that: 

(1) established technologies should be favored; (2) the 

** ' . • 

number of applications does not materially affect the likeli- 
hood of institutionalization; (3) federal support should 
not be limited to a highly limited time period (e.g., one 
^ year) ; (4) projects^ undertaken by state agencies and 




wlversx)bies^^ w multiple service sites are more 

likely to endure th€m local agency 'projects; and ^( cost- 



sharing amd planning grants may or may not contribute to the 
adoption of service innovations. related finding | is that 
educational applications are less risky from an institutionali- 
zation perspective than service delivery or administrative 
applicaticins . 

We believe that above findings can be readily translated 
into OTP's program guidelines cuid selection criteria for the 
demonstration program. For example, we suggest that the 
equipment technolS^ies used in the demonstrations be relatively 
well-established and. reliable. Alternatively/ proposals 
involving more innovative technologies should be- carefully. 

29/ 

screened by OTP with respect to availability and reliability. — ^ 

.' ' ' — ■ ■ * V ■ ■ ■ ■ ^'^^ 

In addition, applicant^ should be re^guired to demonstrate 
that the resources for servicing and/or modifying proposed - 
technical equiginent will be available either internally or 

on a subcontract bagis. 

^ ■ ' " . ■. 

On the question of the types of applications to be tested 
in demonstration projects, our findings suggest that emphasis 
should be placed on educational uses. However, it may be that 



29 / - 

— ^ OTP should consider" drawing on the resoiii^ces of other 
agencies (e.g., NTIA, FCC) or technical consultants to 
verify the availability and reliability of the proposed 
•technical equipment. ^ " 



such an emphasis would run counter to the basic obj6ctives of 
the demonstration program. Proposals that aim to-develop inno- 
vative approaches in service deiivery and administration should 
not be excluded per se, but these proposals should be expected 
to meet vother" selection criteria even more stringently tjhan 
those involving educational applications, so as not to dilutee 
the prospects^ for institutionalization and transfer. With 
respect to the related issue of number of applications per 
demonstration, our findings suggest no need for restrictions 
in this area.—/ ^ 

Given the strong evidence that unreasonable time constraints 
should not be placed on demonstration projects and that several 
years may be needed to go from initial demonstration to institu- 
tionalization, we recommend that a substantial portion o|\ the 
program's funding be allocated to continua«ton grants. ih% is 

not to suggest, however, that all existing projects be auVbomiv 

' . \ \ 4" - _ 

tically refunded. Evidence of progress and the meeting ofv the\ 

■ ... " \ ^ 

types of selection criteria advanced in this report should pre-V 

cede the decision to refund an ongoing project. „ V 



30/ . . ' . 

— Tnxs IS not to imply that a more focused demonstration 
program (e.-^. health-oriented ot multi- service oriented) 
might not be. appropriate for other reasons. It might 
be easier to manage a more focused program and/or to 
complement the efforts of other DHEW and non-DHEW 
agencies . 
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In \Cbnt^:a^t^ the ©vidian 
of pre-demonstration planning grants is not olear^^ Con- 
sequently, we would not recommend the pursuit of formal^ 
requirements in either of these^areas. However , theiprogram 
should consider making a small portion of its funds available . 
for planning grants to applicants who feel this would improve 
the chances of mounting a viable demonstration. Alternatively, 
or in addition tq the planning grant option, dTP should consider 
soliciting pre-proposals from demonstration' greuit applicants* 
This would increase thei^hances of screening salient^, i^eas and 
approaches as well as provide an opportunity for pointing out 
deficiencies in the proposed approach, prior to the applicants' 
having committed stibstantial resources to proposal preparation. 

Finally , the research findings suggest that more careful 
attention may need to be placed on the types of organizations 
that receive demonstratic^^ State agencies r universi- , 



ties, and oth^er organizations with access to severai service 
delivery sites and/or /Organizations capable of close collabora- 
tion with one. -pr more agencies in demonstrating and institu- ' 
tionaliL/zing innovative services should be given a preference' 
over l^cal agencies with more limited institutional ^and staff 
resourcses. 7 Although the findings on this point are not 



11/ Thiis approach has been relied upon, apparently succes s - 
f^lly, by the Jund for the Improvement of--iiQ§tsecondary 
^cucation; ihteryiew with Raymond Lewis, Jr7v\FIPSE, and 
/Keith Baker, Office jof Policy and* Plannin^T-Dlfew. 
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conclusive, they smuggest that certain oirganizationp are more 



likely to be able ip take advantage of iervice delivery "net- 
works" than Others, and that access \c/ such networks may be 
AXL^important ingredient to instltutUoh^Uzation. -^ o 

.. •' • : .' • ^ . ■ I - '^ 

5.2 Fostering Institutionailzation 

* • ■ . ■ ■ \ / ■ \ ■ 

One of the most difficult managerial ch^^llenges for OTP 
will be identifying and evaluating^/ the presend^e of: appropriate 
institutional climates for testing and adopting^ service innova- 
tions. As we noted earlier, the number of inputs necessary 
to carry a service innbvation from "brainstorm" and demonstration 

to adoption and tran.sfer is extremely varied, and. \undoubtedly 

'i • > 'V . ' 

surpasses the resources of any given agency. At the. same time, 

the genesis of a useful service innovation, and the\coinmitment 
to see it become a reality on a- larger scale, may st\jn prin- 
cipally from a small core of individuals. In what ways can 
OTP identify and facilitate the coming together of aft>piropriate 
individual agency and "network" resources? \ 

What follows are several specific approaches that coluld 
individually or collectively increase the chance^ that a 
.demonstration project is institutionalized. The first approach 



\32/ It should be added that these networks can be formal 

\\ (i.e. as in the case of a multi-site state service 

\ agency) or informal (e.g. collaborative relationships 

\ among a group of agencies and/or individuals). 

■ ■ ^ 
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reflects what has been already emphasized above. To foster 
institutionalization, OTP may need to develop more specific 
project selection criteria and devote more resources to eval- 
uating proposals prior to issuing grants. The advarltage of 
this approach is that it concentrates OTP attention on a 
l^'particular phase of the demons tration-.pa:ocess --" grantee 
selection. Scrutinizing the budgetary, Jtechnical, and insti- 
tutional capabilities of applicants in' greater detail dould 
increase the prospects of ultimate innovation adoption Con- 
siderably. The disadvantage is that the research on which 
selection criteria »might be based is still limited, and that 
the proposal requirements which applicants must meet are already 
extensive; adding additional ones could be burdensome. 

* 

The above approach could also burden OTP's limited resources 
requiring probably one or more site visits per applicant. An 
alternative is to place more emphasis on the applicant agency 
demonstrating that it has sufficient ties, with external insti- 
tut ions and individuals, who could play a role in the adoption 
or transfer of the innovatipn. For example, each applicant 
could be required or, at least, encouraged to form an 
advisory board, consisting of representatives of collaborating 
service agencies, user groups and community leaders. 



However, when combined with the "preproposals" suggestion, 
which , would screen out many applicants, the number of appli- 
cants who would need to demonstrate their ability to meet 
the increased proposal requirementis would be reduced. 



Sitili a third approach would be for OTP to directly asaiat 
aelected demons tratii on proj^^cta in movinig f rem the demonstration 
to the, institutionalization phase. The effort involved might 
be .two-pronged. On the onri hand, OTP could, require the projects 
to undertake some inatitutionalixation-oriented planning activi- 
ties (includin'g financial planning and service management) 
as the demons tractions progress. On the other, OTP. could support 
these steps by advising the grantees on alternative approaches . 
to achieving operitional self-sufficiency, helping in the promo- 
tion of worthwhile projects and serving as a clearinghouse for 
sources of ' funding Wnd/or technical assistance in IDHEW and 
elsewhere. This type of support role, if implemented 
pefiective^ly, could, contribute/significantly to the adoption 
of service innovation on an ongoing basis; however, it would 
undoubtedly require greater staff resources than are currently 
available to OTP. ^ , , 

• • 

A final option that should be considered is the encouragement 
of national -"networking" iri telecommunications-relisted public 
-service delivery. This is an activity that OTP is already "~ 
pursuing in both formal and informal ways ^ , However, the role 
c^uld ^ strengthened by developing a regular program of 
activities, including, for 'example : ' (1) the organization of 
an annual workshop, {2) the conducting of special seminars 
on particular public service areas, (3) the encouragement 
of regular contacts among demonstration, project staffs , 
(4) the management , of a clearinghouse of f uncling and information 



r«foiu||&/iii .and (5) th« puJ^Uihing o£ a nawalattar o£ pariodio 
refarinca worka. Soma o^/ thaaa aotivltiaa oould ba unda.rtaken ^ 
on a ^||oint baaia with othar .DHEW aganclaa- and/or othat / * 
orgartizationo auch aa NTIA, Cabla Talavlaion Information v 
Can and univarsity programa among othera. 

It may be useful to pursue" all of the directions noted 
at/ove. Howeverv resource limitations are not likely to permit 

lis. Which particular option is selected should depand on the 
Level of resources available (including staff predispositions • 
toward. a given option), the tj^e of relationship with grantees 
that OTP will be comfortable in maintaining, . and the priorities 
the program sets for itself. For example, if building awareness, 
of new service delivery approaches is paramount, the networking 
approaches may be most appropriate. In contrast, if the princi- 
pal objective over the next two or three years is to demonstrate, 
that innovative sei^vices can be turned into operational programs , 
then greater emphasis should be placed on selecting appropriate 
grantees and/or assisting individual projects in achieving 
operational status. 
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